Cross-platofrm data visualizations using common descriptions

ABSTRACT

The present invention extends to methods, systems, and computer program products for cross-platform data visualizations using common descriptions. Embodiments of the invention provide mechanisms for simplifying software development and enhanced code reliability. A user interface, along with interactive and dynamic characteristics, can be described (programmatically and/or declaratively) independently of any specific device platform. User interface qualities can be described using a generic scene graph structure with attached behaviors. The generic scene graph can then be used to drive the user interface on any number of different computing platforms using platform specific (e.g., rendering, gesture recognition, etc.) sub-systems. Platform specific sub-systems can vary based on technologies that are used by the platform specific sub-systems. For example, rendering sub-systems can vary based on the technology used to render graphical data, such as, for example, Open GL, XAML, Direct X, Quartz, etc.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of and claims the benefit of andpriority to U.S. patent application Ser. No. 15/423,904, entitled“Cross-Platform Data Visualizations Using Common Descriptions”, filedFeb. 3, 2017 by Fabian O. Winternitz et al., the entire contents ofwhich are expressly incorporated by reference. That application is acontinuation of and claims the benefit of and priority to U.S. patentapplication Ser. No. 14/792,059, now U.S. Pat. No. 9,600,915, entitled“Cross-Platform Data Visualizations Using Common Descriptions”, filedJul. 6, 2015 by Fabian O. Winternitz et al., the entire contents ofwhich are expressly incorporated by reference. That application is acontinuation of and claims the benefit of and priority to U.S. patentapplication Ser. No. 13/668,206, now U.S. Pat. No. 9,075,618, entitled“Cross-Platform Data Visualizations Using Common Descriptions”, filedNov. 2, 2012 by Fabian O. Winternitz et al., the entire contents ofwhich are expressly incorporated by reference.

BACKGROUND 1. Background and Relevant Art

Computer systems and related technology affect many aspects of society.Indeed, the computer system's ability to process information hastransformed the way we live and work. Computer systems now commonlyperform a host of tasks (e.g., word processing, scheduling, accounting,etc.) that prior to the advent of the computer system were performedmanually. More recently, computer systems have been coupled to oneanother and to other electronic devices to form both wired and wirelesscomputer networks over which the computer systems and other electronicdevices can transfer electronic data. Accordingly, the performance ofmany computing tasks is distributed across a number of differentcomputer systems and/or a number of different computing environments.

Different computing platforms (e.g., Windows, iOS, etc.) typically usedifferent platform specific technologies for interacting with (e.g.,rendering and receiving input gestures from) data visualizations, suchas, for example, charts, grids, tiles, etc. Due to differences andcomplexities in platform specific technologies, developing consistent,highly interactive user interfaces for use across multiple computingplatforms can be challenging and time consuming. For example, developersmay have to maintain multiple code bases, one for each differentcomputing platform in use. Each code base can include various platformspecific mechanisms available to a computing platform and that maydiffer across different computing platforms.

Other cross platform development challenges include difficult of testingof cross-platform applications. Testing cross-platform applications maybe considerably more complicated, since different platforms can exhibitslightly different behaviors or subtle bugs. Further, developers areoften restricted to using the lowest common denominator subset offeatures which are available on all platforms. This may hinder theapplication's performance or prohibit developers from using platforms'most advanced features.

Different platforms often have different user interface conventions,which cross-platform applications do not always accommodate. Forexample, applications developed for Mac OS X and GNOME are supposed toplace the most important button on the right-hand side of a window ordialog, whereas Microsoft Windows and KDE have the opposite convention.Though many of these differences are subtle, a cross-platformapplication which does not conform appropriately to these conventionsmay feel clunky or alien to the user. When working quickly, suchopposing conventions may even result in data loss, such as in a dialogbox confirming whether the user wants to save or discard changes to afile.

Cross-platform execution environments may also suffer cross-platformsecurity flaws, creating an environment susceptible to cross-platformmalware.

BRIEF SUMMARY

The present invention extends to methods, systems, and computer programproducts for cross-platform data visualizations using commondescriptions. Some embodiments of the invention include outputting datavisualizations. A scene graph processing layer accesses a generic scenegraph from common code that is executable on a plurality of differenttechnology platforms. The generic scene graph represents a userinterface. The generic scene graph defines data visualizationsindependent of any of a plurality of different platform specific userinterface sub-systems. The generic scene graph contains scene graphmetadata that describes characteristics of the data visualizations.

The scene graph processing layer interprets the structure and data of atleast portions of the generic scene graph into specific operations thatare processed by a platform specific rendering sub-system. The scenegraph processing layer makes decisions on how to process individualscene graph nodes or groups of scene graph nodes based on thecharacteristics of rendering subsystems a platform provides. Forexample, the scene graph processing layer can make decisions based onthe most optimal rendering sub-system the platform provides. The scenegraph processing layer sends the specific operations to the platformspecific rendering sub-system for processing. The platform specificrendering sub-system outputs the data visualizations by processing thespecific operations. Outputting data visualizations can includerendering to a display device, writing to a file, sending via networkcommunication to another system, etc.

Other embodiments of the invention include processing an input gesture.A scene graph processing layer accesses a generic scene graph fromcommon code that is executable on a plurality of different technologyplatforms. The generic scene graph represents a user interface. Thegeneric scene graph defines behaviors for input gesture processingindependent of any of a plurality of different platform specific userinterface sub-systems. The generic scene graph contains scene graphmetadata that describes characteristics of the behaviors.

The scene graph processing layer receives input gesture data from aplatform specific user interface sub-system. The input gesture data isfor an input gesture recognized by utilizing a gesture recognitiontechnique available to the platform specific user interface sub-system.The scene graph processing layer adjusts the input gesture data forconsistency with the generic scene graph based on the utilized gesturerecognition technique and in view of the scene graph metadata. The scenegraph processing layer routes the adjusted input gesture data to anappropriate behavior in the generic scene graph.

This summary is provided to introduce a selection of concepts in asimplified form that are further described below in the DetailedDescription. This Summary is not intended to identify key features oressential features of the claimed subject matter, nor is it intended tobe used as an aid in determining the scope of the claimed subjectmatter.

Additional features and advantages of the invention will be set forth inthe description which follows, and in part will be obvious from thedescription, or may be learned by the practice of the invention. Thefeatures and advantages of the invention may be realized and obtained bymeans of the instruments and combinations particularly pointed out inthe appended claims. These and other features of the present inventionwill become more fully apparent from the following description andappended claims, or may be learned by the practice of the invention asset forth hereinafter.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to describe the manner in which the above-recited and otheradvantages and features of the invention can be obtained, a moreparticular description of the invention briefly described above will berendered by reference to specific embodiments thereof which areillustrated in the appended drawings. Understanding that these drawingsdepict only typical embodiments of the invention and are not thereforeto be considered to be limiting of its scope, the invention will bedescribed and explained with additional specificity and detail throughthe use of the accompanying drawings in which:

FIGS. 1A and 1B illustrate an example computer architecture thatfacilitates cross-platform data visualizations using commondescriptions.

FIG. 2 illustrates an example computer architecture for outputting datavisualizations and processing input gestures from data visualizations.

FIG. 3 illustrates a flow chart of an example method for outputting adata visualization.

FIG. 4 illustrates a flow chart of an example method for processing aninput gesture from a data visualization.

FIG. 5 illustrates utilizing a generic scene graph on differentcomputing platforms.

DETAILED DESCRIPTION

The present invention extends to methods, systems, and computer programproducts for cross-platform data visualizations using commondescriptions. Some embodiments of the invention include outputting datavisualizations. A scene graph processing layer accesses a generic scenegraph from common code that is executable on a plurality of differenttechnology platforms. The generic scene graph represents a userinterface. The generic scene graph defines data visualizationsindependent of any of a plurality of different platform specific userinterface sub-systems. The generic scene graph contains scene graphmetadata that describes characteristics of the data visualizations.

The scene graph processing layer interprets the structure and data of atleast portions of the generic scene graph into specific operations thatare processed by the platform specific user interface sub-system. Thescene graph processing layer makes decisions on how to processindividual scene graph nodes or groups of scene graph nodes based on thecharacteristics of rendering subsystems a platform provides. Forexample, the scene graph processing layer can make decisions based onthe most optimal rendering sub-system the platform provides. The scenegraph processing layer sends the specific operations to the platformspecific rendering sub-system for processing. The platform specificrendering sub-system outputs the data visualizations by processing thespecific operations. Outputting data visualizations can includerendering to a display device, writing to a file, sending via networkcommunication to another system, etc.

Other embodiments of the invention include processing an input gesture.A scene graph processing layer accesses a generic scene graph fromcommon code that is executable on a plurality of different technologyplatforms. The generic scene graph represents a user interface. Thegeneric scene graph defines behaviors for input gesture processingindependent of any of a plurality of different platform specific userinterface sub-systems. The generic scene graph contains scene graphmetadata that describes characteristics of the behaviors.

The scene graph processing layer receives input gesture data from aplatform specific user interface sub-system. The input gesture data isfor an input gesture recognized by utilizing a gesture recognitiontechnique available to the platform specific user interface sub-system.The scene graph processing layer adjusts the input gesture data forconsistency with the generic scene graph based on the utilized gesturerecognition technique and in view of the scene graph metadata. The scenegraph processing layer routes the adjusted input gesture data to anappropriate behavior in the generic scene graph.

Embodiments of the present invention may comprise or utilize a specialpurpose or general-purpose computer including computer hardware, suchas, for example, one or more processors, system memory, and a touchscreen display device, as discussed in greater detail below. Embodimentswithin the scope of the present invention also include physical andother computer-readable media for carrying or storingcomputer-executable instructions and/or data structures. Suchcomputer-readable media can be any available media that can be accessedby a general purpose or special purpose computer system.Computer-readable media that store computer-executable instructions arecomputer storage media (devices). Computer-readable media that carrycomputer-executable instructions are transmission media. Thus, by way ofexample, and not limitation, embodiments of the invention can compriseat least two distinctly different kinds of computer-readable media:computer storage media (devices) and transmission media.

Computer storage media (devices) includes RAM, ROM, EEPROM, CD-ROM,solid state drives (“SSDs”) (e.g., based on RAM), Flash memory,phase-change memory (“PCM”), other types of memory, other optical diskstorage, magnetic disk storage or other magnetic storage devices, or anyother medium which can be used to store desired program code means inthe form of computer-executable instructions or data structures andwhich can be accessed by a general purpose or special purpose computer.

A “network” is defined as one or more data links that enable thetransport of electronic data between computer systems and/or modulesand/or other electronic devices. When information is transferred orprovided over a network or another communications connection (eitherhardwired, wireless, or a combination of hardwired or wireless) to acomputer, the computer properly views the connection as a transmissionmedium. Transmissions media can include a network and/or data linkswhich can be used to carry desired program code means in the form ofcomputer-executable instructions or data structures and which can beaccessed by a general purpose or special purpose computer. Combinationsof the above should also be included within the scope ofcomputer-readable media.

Further, upon reaching various computer system components, program codemeans in the form of computer-executable instructions or data structurescan be transferred automatically from transmission media to computerstorage media (devices) (or vice versa). For example,computer-executable instructions or data structures received over anetwork or data link can be buffered in RAM within a network interfacemodule (e.g., a “NIC”), and then eventually transferred to computersystem RAM and/or to less volatile computer storage media (devices) at acomputer system. Thus, it should be understood that computer storagemedia (devices) can be included in computer system components that also(or even primarily) utilize transmission media.

Computer-executable instructions comprise, for example, instructions anddata which, when executed at a processor, cause a general purposecomputer, special purpose computer, or special purpose processing deviceto perform a certain function or group of functions. The computerexecutable instructions may be, for example, binaries, intermediateformat instructions such as assembly language, or even source code.Although the subject matter has been described in language specific tostructural features and/or methodological acts, it is to be understoodthat the subject matter defined in the appended claims is notnecessarily limited to the described features or acts described above.Rather, the described features and acts are disclosed as example formsof implementing the claims.

Those skilled in the art will appreciate that the invention may bepracticed in network computing environments with many types of computersystem configurations, including, personal computers, desktop computers,laptop computers, message processors, hand-held devices, multi-processorsystems, microprocessor-based or programmable consumer electronics,network PCs, minicomputers, mainframe computers, mobile telephones,PDAs, tablets, pagers, routers, switches, and the like. The inventionmay also be practiced in distributed system environments where local andremote computer systems, which are linked (either by hardwired datalinks, wireless data links, or by a combination of hardwired andwireless data links) through a network, both perform tasks. In adistributed system environment, program modules may be located in bothlocal and remote memory storage devices.

Embodiments of the invention can also be implemented in cloud computingenvironments. In this description and the following claims, “cloudcomputing” is defined as a model for enabling on-demand network accessto a shared pool of configurable computing resources. For example, cloudcomputing can be employed in the marketplace to offer ubiquitous andconvenient on-demand access to the shared pool of configurable computingresources. The shared pool of configurable computing resources can berapidly provisioned via virtualization and released with low managementeffort or service provider interaction, and then scaled accordingly.

A cloud computing model can be composed of various characteristics suchas, for example, on-demand self-service, broad network access, resourcepooling, rapid elasticity, measured service, and so forth. A cloudcomputing model can also expose various service models, such as, forexample, Software as a Service (“SaaS”), Platform as a Service (“PaaS”),and Infrastructure as a Service (“IaaS”). A cloud computing model canalso be deployed using different deployment models such as privatecloud, community cloud, public cloud, hybrid cloud, and so forth. Inthis description and in the claims, a “cloud computing environment” isan environment in which cloud computing is employed.

Embodiments of the invention provide mechanisms for simplifying softwaredevelopment and enhanced code reliability. A user interface, along withinteractive and dynamic characteristics, can be described(programmatically and/or declaratively) independently of any specificdevice platform. User interface qualities can be described using ageneric scene graph structure with attached behaviors. The generic scenegraph can then be used to drive the user interface on any number ofdifferent computing platforms using platform specific (e.g., rendering,gesture recognition, etc.) sub-systems. Platform specific sub-systemscan vary based on technologies that are used by the platform specificsub-systems. For example, rendering sub-systems can vary based on thetechnology used to render graphical data, such as, for example, OpenGL,XAML, DirectX, Cocoa/Quartz, etc.

Specifying both static and dynamic user interface structures in a commonway (that can then be used on multiple different computing platforms)enables more efficient code delivery, more code re-use and higherquality experiences. Specifying user interface structures in a commonway also minimizes having to develop large and/or complex quantities ofcode for different computing platforms. Specifying user interfacestructures in a common way also helps insure that user interfacefunctionality is consistent and reliable on different computingplatforms.

In general, a scene graph is a hierarchical way of organizing graphicalor visual data that is to be rendered onto a screen. Each node in thescene graph typically represents a visual element in the user interface.A high level parent node in the graph can represent a complex visualelement (e.g., a bar chart). The parent node is in turn composed ofchild nodes that each represents a constituent visual element of theparent visual (e.g. axes, bars, legend). The child nodes are similarlycomposed of child nodes that represent progressively simpler visualelements (e.g. lines, shapes, text labels).

Nodes in a scene graph can have common attributes such as size,position, orientation, opacity, etc. Child nodes in the scene graph arepositioned relative to their parent nodes. As such, visuals in the userinterface can be more easily moved or reoriented by setting the positionor orientation of the corresponding root node in the scene graph. Childnodes can be properly positioned when rendered since their position isdefined relative to their parent. A similar mechanism can be used topropagate visual style information through the hierarchy. For example,setting the opacity of a parent node can cause child nodes to berendered using the same opacity value.

FIGS. 1A and 1B illustrate an example computer architecture 100 thatfacilitates cross-platform data visualizations using commondescriptions. Referring to FIG. 1A, computer architecture 100 includesmodel layer 101, presented layer 111, view layer 121, and platformabstraction layer 131. Components at each of model layer 101, presentedlayer 111, view layer 121, and platform abstraction layer 131 can beconnected to one another over (or be part of) a local bus and/or anetwork, such as, for example, a Local Area Network (“LAN”), a Wide AreaNetwork (“WAN”), and even the Internet. Accordingly, components at eachof model layer 101, presented layer 111, view layer 121, and platformabstraction layer 131 as well as any other connected computer systemsand their components, can create message related data and exchangemessage related data (e.g., Internet Protocol (“IP”) datagrams and otherhigher layer protocols that utilize IP datagrams, such as, TransmissionControl Protocol (“TCP”), Hypertext Transfer Protocol (“HTTP”), SimpleMail Transfer Protocol (“SMTP”), etc.) over the local bus and/ornetwork.

As depicted, model layer 101 includes query response handler 102, data103, and visual state 104. In general, the components of model layer 101can interoperate to formulate a model defining data to be displayed orotherwise acted upon at a user interface. For example, chart definition106 can define chart 138 that is to be displayed or otherwise acted uponat a user interface.

Presenter layer 111 includes hosting components 112. Hosting components112 further include document controller 171, canvas 172, visualizationpane 173, and visualization host 174. In general, presenter layer 111also includes a presenter corresponding to the model type definitionformulated in the model. In general, a presenter also acts upon a modeland a view. The presenter retrieves data from repositories (the model),and formats it for display in the view.

As depicted, presenter layer 111 includes chart presenter 113. Chartpresenter 113 includes chart data mapper 114, chart scene builder 116,and interaction handler 117. Chart presenter 113 can access chartdefinition 106 as well as data from hosting components 112. Chart datamapper 114, chart scene builder 116, and interaction handler 117 caninteroperate to format chart definition 106 into scene graph 122.

View layer 121 includes scene graph 122. Scene graph 122 is an interfacethat displays data (chart definition 106). Scene graph 122 includes node182 (the root node), node 183 (corresponding to chart 138), node 184(for scrollview), node 166 (corresponding to stacked column 162), node167 (corresponding to stacked column 163), and node 186 (correspondingto a label of stacked column 163). Nodes corresponding to other userinterface elements in chart 138 can also be included in scene graph 122.

Scene graph 122 also includes dependency properties 181 definingbehaviors attached to nodes. Attached behaviors can be used to specifyhow visual elements in the user interface are animated. Stock animations(such as easing functions) can be encapsulated in easy-to-reusebehaviors that can be simply attached to the node to be animated. Morecomplex animations can be represented using configurable behaviorsspecifying the parameters of the animation and/or the target property ofthe node to be animated. Attached behaviors can also be used to specifythe styling behavior of nodes in a scene graph so that the propagationof style information to child nodes (colors, fonts, opacity, visualeffects, etc.) can be controlled.

Attached behaviors can encapsulate programmatic logic (such as layoutlogic described above) or can encapsulate information (meta-data) thatcan be used by a platform specific user interface sub-system (e.g., arendering sub-system) to implement the specific behavior described. Assuch, attached behaviors represent a way to extend the scene graphapproach so that it can be used to represent highly interactive userinterfaces in a platform independent way. Attached behaviors can definethe interactive nature of a user interface in a platform independentmanner. Definition in a platform independent manner allows the platformspecific user interface sub-systems to focus on translating behaviorsinto an efficient platform dependent implementation using appropriateplatform specific tools and technologies.

Attached behaviors can be used to specify how a user interface is to berendered for users requiring keyboard or screen reader support. Forexample, screen reader behaviors can be attached to certain nodes in ascene graph and used by the rendering sub-system to drive the platformspecific screen reader implementation. Similarly, keyboard accessibility(shortcut keys, tab/focus control, etc.) can be configured by usingbehaviors attached to nodes in the scene graph. In these cases, adesired application behavior can be specified in a platform independentway using attached behaviors. Again, allowing platform specific userinterface sub-systems to efficiently implement the behaviors usingplatform specific technologies.

Platform abstraction layer 131 includes resource manager 132, animationengine 134, and rendering engine 136. Resource manager 132 is configuredto manage the resources consumed to output chart 138. Animation engine134 is configured to implement animation logic using platform specifictechnologies. Rendering engine 136 (or some other output engine)implements rendering (or other output techniques) using platformspecific technologies. For example, rendering engine 136 can renderchart 138 on a display device. Alternately, other platform specific userinterface sub-systems can output the data for chart 138 to a file.

Alternately, other platform specific user interface sub-systems canoutput the data for chart 138 via network communication to anothercomputing device for further processing. The other computing device caninclude a rendering sub-system for rendering chart 138. The othercomputing system can return chart 138 via network communication forpresentation in platform abstraction layer 131.

Attached behaviors can be used to specify how user input gestures(touch, mouse, keyboard, voice, video, etc., input gestures) are to behandled. Behaviors that represent specific gestures (such as tap, swipe,click) can be attached to a node in a scene graph and configured toinvoke a certain command or action in the application. When a gesturerecognizer detects a user input gesture, it routes input gesture data tothe nearest scene graph for which a suitable gesture behavior isattached. The associated command or action is then automaticallyinvoked. Gesture behaviors for different touch gestures can be attachedto nodes throughout a scene graph hierarchy to implement more complexgesture handling scenarios.

Turning to FIG. 1B, platform abstraction layer 131 also includes gesturerecognizer 133. Gesture recognizer 133 is responsible for handling userinput and for routing event information to an appropriate behavior inscene graph 122. Gesture recognizer 133 can route gesture input data toan appropriate behavior in scene graph 122. The behavior in scene graph122 can then route event data to presenter layer 111 to act upon data inchart 138 (e.g., activating an animation).

In some embodiments, a platform abstraction layer also includes a scenegraph processing layer that is situated between a generic scene graphicand platform specific user interface sub-systems. The scene graphprocessing layer can select appropriate platform specific technologiesfor efficiently outputting a data visualization in view of hintsindicated in the scene graph. In some embodiments, a scene graphprocessing layer selects different platform specific technologies basedthe number of nodes or type of nodes in a scene graph. For example,depending on the number of nodes in a scene graph, a scene graphprocessing layer can instruct a rendering sub-system to use retainedmode or immediate mode when rendering a data visualization.

A scene graph processing layer can also adjust input gesture data forconsistency with a scene graph.

Turning to FIG. 2, FIG. 2 illustrates an example computer architecture200 for outputting data visualizations and processing input gesturesfrom data visualizations. Referring to FIG. 2, computer architecture 200includes view layer 201 and platform abstraction layer 211. Componentsat each of view layer 201 and platform abstraction layer 211 can beconnected to one another over (or be part of) a local bus and/or anetwork, such as, for example, a Local Area Network (“LAN”), a Wide AreaNetwork (“WAN”), and even the Internet. Accordingly, components at eachof model view layer 201 and platform abstraction layer 211 as well asany other connected computer systems and their components, can createmessage related data and exchange message related data (e.g., InternetProtocol (“IP”) datagrams and other higher layer protocols that utilizeIP datagrams, such as, Transmission Control Protocol (“TCP”), HypertextTransfer Protocol (“HTTP”), Simple Mail Transfer Protocol (“SMTP”),etc.) over the local bus and/or network.

View layer 201 includes scene graph 202. Scene graph 220 includes nodes203, 204, 206, and 207 representing graphical elements in chart 217.Scene graph 202 also includes behaviors 281, 282, and 283 representingactions that can be taken on data in chart 217.

Platform 227 includes platform specific rendering sub-system 214 andplatform specific gesture recognition sub-system 216. Platform 227 canbe differentiated from other platforms by hardware and/or software usedby platform 227. For example, platform 227 can be a Microsoft® Windows®platform (using XAML), which is different than an Apple® iOS platform(using Quartz).

In general, behaviors in scene graph 202 can be handled at scene graphprocessing layer 212 and used to generate operations for efficientlyoutputting a data visualization at platform specific renderingsub-system 214. Platform specific rendering sub-system 214 can berendering sub-system, a file writing sub-system, or a networkcommunication sub-system. Scene graph processing layer 212 can bespecifically configured for use with platform 227. As such, scene graphprocessing layer 212 is aware of the characteristics of renderingsub-systems available to platform 227.

FIG. 3 illustrates a flow chart of an example method 300 for outputtinga data visualization. Method 300 will be described with respect to thecomponents and data of computer architecture 200.

Method 300 includes the scene graph processing layer accessing a genericscene graph from common code that is executable on a plurality ofdifferent technology platforms, the generic scene graph representing auser interface, the generic scene graph defining data visualizationsindependent of any of a plurality of different platform specific userinterface sub-systems, the generic scene graph containing scene graphmetadata that describes characteristics of the data visualizations(301). For example, scene graph processing layer 212 can access scenegraph 202. Scene graph 202 can originate from a presenter layer. Scenegraph 202 can be included in common code that is executable on aplurality of different technology platforms. Scene graph 202 defineschart 237 independent of any plurality of different platform specificuser interface sub-systems, such as, for example, sub-systems that useQuartz® for rendering or sub-systems that XAML for rendering. Scenegraph 202 contains metadata that describes chart 217. Metadata can beexpressly included in scene graph 202 or can be inferred from thefeatures of scene graph 202.

Method 300 includes the scene graph processing layer interpreting thestructure and data of at least portions of the generic scene graph intospecific operations that are processed by a platform specific renderingsub-system, the scene graph processing layer making decisions on how toprocess individual scene graph nodes or groups of scene graph nodesbased on characteristics of rendering subsystems a platform provides(act 302). For example, scene graph processing layer 212 can interpretthe structure and data of portions of scene graph 202 into operations213 for consumption by platform specific rendering sub-system 214. Scenegraph processing layer 212 can make decisions on how to processindividual scene graph nodes or groups of scene graph nodes form scenegraph 222 based on characteristics of rendering subsystems in platform227, including platform specific rendering sub-system 214. Renderingsub-system characteristics can include current machines state, such as,for example, available memory, CPU speed, etc.

Scene graphic processing layer 212 can make decisions based on the mostoptimal rendering sub-system the platform provides. Scene graphprocessing layer 212 can optimize operations 213 for efficientprocessing (e.g., immediate mode versus retained mode or vice versa) atplatform specific rendering sub-system 214 based on data visualizationprocessing techniques available platform specific rendering sub-system214 and in view of metadata from scene graph 202.

Method 300 includes the scene graph processing layer sending thespecific operations to the platform specific rendering sub-system forprocessing (303). For example, scene graph processing layer 212 can sendoperations 213 to platform specific rendering sub-system 214 forprocessing. Platform specific rendering sub-system 214 can receiveoperations 213 from scene graph processing layer 212.

Method 300 includes the platform specific rendering sub-systemoutputting the data visualizations by processing the specific operations(304). For example, platform specific rendering sub-system 214 canoutput data visualization data 247 by processing operations 213. In someembodiments, platform specific rendering sub-system 214 renders datavisualization data 247 as chart 217. In other embodiments, platformspecific rendering sub-system 214 renders data visualization data 247 toa file or sends data visualization data 247 via network communication toanother system for further processing respectively.

As described, scene graph processing layer 212 can be specificallyconfigured for use with platform 227. As such, scene graph processinglayer 212 is aware of gesture recognition techniques and input gesturedata formats available to platform specific gesture recognitionsub-system 216.

FIG. 4 illustrates a flow chart of an example method 400 for processingan input gesture from a data visualization. Method 400 will be describedwith respect to the components and data of computer architecture 200.

Method 400 includes a scene graph processing layer accessing a genericscene graph from common code that is executable on a plurality ofdifferent technology platforms, the generic scene graph representing auser interface, the generic scene graph defining behaviors for inputgesture processing independent of any of a plurality of differentplatform specific user interface sub-systems, the generic scene graphcontaining scene graph metadata that describes characteristics of thebehaviors (401). For example, scene graph processing layer 212 canaccess scene graph 202. Scene graph 202 can originate from a presenterlayer. Scene graph 202 can be included in common code that is executableon a plurality of different technology platforms. Scene graph 202defines touch event behavior 284 independent of any plurality ofdifferent platform specific user interface sub-systems, such as, forexample, sub-systems that use Quartz for rendering and sub-systems thatXAML for rendering. Scene graph 202 can contain metadata that describesthe characteristics of touch event behavior 284, such as, for example, adata format.

A user can enter touch input 219 onto a touch screen display devicedisplaying chart 217. Platform specific gesture recognition sub-system216 can recognize touch selection 241 as specified type of input gesture(e.g., swipe, select, tap, etc.) by utilizing an available gesturerecognition technique on touch input 219. Platform specific gesturerecognition sub-system 216 can generate input gesture data 221 based onthe specified type of input gesture. Platform specific gesturerecognition sub-system 216 can send input gesture data 221 to scenegraph processing layer 212.

Method 400 includes the scene graph processing layer receiving inputgesture data from the platform specific user interface sub-system, theinput gesture data for an input gesture recognized by utilizing agesture recognition technique available to the platform specific userinterface sub-system (402). For example, scene graph processing layer212 can receive input gesture data 221 from platform specific gesturerecognition sub-system 216.

Method 400 includes the scene graph processing layer adjusting the inputgesture data for consistency with the generic scene graph based on theutilized gesture recognition technique and in view of the scene graphmetadata (403). For example, scene graph processing layer 212 can adjustinput gesture data 221 into adjusted input gesture data 222. Inputgesture data 221 can be adjusted into adjusted input gesture data 222for consistency with scene graph 202 based on the gesture recognitiontechnique used by platform specific gesture recognition sub-system 216and in view of metadata describing touch event behavior 284.

Method 400 includes the scene graph processing layer routing theadjusted input gesture data to an appropriate behavior in the genericscene graph (404). For example, scene graph processing layer 212 canroute adjusted input gesture data 222 to touch event behavior 284. Touchevent behavior 284 can in turn translate adjusted input gesture data 222into event data 248. Touch event behavior 284 can send data 248 to apresenter layer for processing.

FIG. 5 illustrates utilizing a generic scene graph 501 on differentcomputing platforms. As depicted, FIG. 5 includes platform 512 andplatform 522. Platform 512 and platform 522 can be differentiated byhardware and/or software. For example, platform 512 can include an ARMprocessor, use Microsoft® Windows® as an operating system, and can useXAML for graphical rendering. On the other hand, platform 522 caninclude an A6 processor, use Apple® iOS as an operating system, and useQuartz® for graphical rendering.

Platform 512 includes scene graph processing layer 513. Scene graphprocessing layer 513 is configured for use with platform specificsub-systems 514. Thus, scene graph processing layer 513 is aware of datavisualization output (e.g., rendering) techniques and gesturerecognition techniques available to platform specific sub-systems 514.

Likewise, platform 522 includes scene graph processing layer 523. Scenegraph processing layer 523 is configured for use with platform specificsub-systems 524. Thus, scene graph processing layer 523 is aware of datavisualization output (e.g., rendering) techniques and gesturerecognition techniques available to platform specific sub-systems 524.Scene graph processing layer 513 and scene graph processing layer 523can account for the differences in platforms 512 and 522 respectively.As such, both of platforms 512 and 522 can appropriately utilize scenegraph 501 in an efficient and consistent manner.

For example, scene graph processing layer 513 can configure operations,such as, operations 516, for efficiently rendering a data visualizationat platform specific sub-systems 514. The configuration of operationscan be based on the data visualization output techniques available atplatform specific sub-systems 514 and in view of metadata indicated inscene graph 501. Scene graph processing layer 513 can also adjust inputgesture data platform specific sub-systems 514, such as, input gesturedata 517, for consistency with scene graph 501. Input gesture data canbe adjusted based on the gesture recognition techniques available toplatform specific sub-systems 514 and any metadata related to inputgesture behaviors in scene graph 501.

Likewise, scene graph processing layer 523 can configure operations,such as, operations 526, for efficiently rendering a data visualizationat platform specific sub-systems 524. The configuration of operationscan be based on the data visualization output techniques available atplatform specific sub-systems 524 and in view of metadata indicated inscene graph 501. As such, configuring operations for efficient renderingat platform specific sub-systems 524 can be different than configuringoperations for efficient rendering at platform specific sub-systems 514.

Scene graph processing layer 523 can also adjust input gesture data fromplatform specific sub-systems 524, such as, input gesture data 527, forconsistency with scene graph 501. Input gesture data can be adjustedbased on the gesture recognition techniques available to platformspecific sub-systems 524 and any metadata related to input gesturebehaviors in scene graph 501. As such, adjusting input gesture data fromplatform specific sub-systems 524 can different from adjusting inputgesture data from platform specific sub-systems 514.

The present invention may be embodied in other specific forms withoutdeparting from its spirit or essential characteristics. The describedembodiments are to be considered in all respects only as illustrativeand not restrictive. The scope of the invention is, therefore, indicatedby the appended claims rather than by the foregoing description. Allchanges which come within the meaning and range of equivalency of theclaims are to be embraced within their scope.

1. A computer system comprising: a processor; system memory coupled tothe processor and storing instructions configured to cause the processorto: access a generic scene graph defining a platform independent inputgesture processing behavior including scene graph metadata thatdescribes characteristics of the behavior; receive input gesture datafrom a device platform; recognize a corresponding input gesture from theinput gesture data by utilizing a gesture recognition technique; adjustthe input gesture data into a format compatible with the generic scenegraph in view of the scene graph metadata; and automatically invoke adata visualization action responsive to the input gesture and associatedwith the platform independent input gesture processing behavior.
 2. Thesystem of claim 1, further comprising instructions configured to inferthe scene graph metadata from features of the generic scene graph. 3.The system of claim 1, wherein the instructions configured to access ageneric scene graph comprise instructions configured to access a genericscene graph that defines a touch input gesture processing behavior. 4.The system of claim 1, wherein instructions configured to receive inputgesture data from a device platform comprise instructions configured toreceive input gesture data from one of: a rendering sub-system, a filewriting sub-system, or a network communication sub-system.
 5. The systemof claim 1, wherein instructions configured to access a generic scenegraph comprise instructions configured to access a generic scene graphthat declaratively defines the platform independent input gestureprocessing behavior.
 6. The system of claim 1, wherein instructionsconfigured to access a generic scene graph comprise instructionsconfigured to access a generic scene graph that programmatically definesthe platform independent input gesture processing behavior.
 7. Thesystem of claim 1, wherein instructions configured to receive inputgesture data comprise instructions configured to receive at least oneof: mouse input gesture data or keyboard input gesture data.
 8. Thesystem of claim 1, wherein instructions configured to receive inputgesture data comprise instructions configured to receive at least oneof: voice input gesture data or video input gesture data.
 9. The systemof claim 1, wherein instructions configured to recognize a correspondinginput gesture comprises instructions configured to utilize a gesturerecognition technique available to the device platform.
 10. A methodcomprising: accessing a generic scene graph defining a platformindependent input gesture processing behavior including scene graphmetadata that describes characteristics of the behavior; receiving inputgesture data from a device platform; recognizing a corresponding inputgesture from the input gesture data by utilizing a gesture recognitiontechnique; adjust the input gesture data into a format compatible withthe generic scene graph in view of the scene graph metadata; andautomatically invoke a data visualization action responsive to the inputgesture and associated with the platform independent input gestureprocessing behavior.
 11. The method of claim 10, further comprisinginferring the scene graph metadata from features of the generic scenegraph.
 12. The method of claim 10, wherein accessing a generic scenegraph comprises accessing a generic scene graph that defines touch inputgesture processing behaviors.
 13. The method of claim 10, whereinreceiving input gesture data from a device platform comprises receivinginput gesture data from one of: a rendering sub-system, a file writingsub-system, or a network communication sub-system.
 14. The method ofclaim 10, wherein accessing a generic scene graph comprises accessing ageneric scene graph that declaratively defines the platform independentinput gesture processing behavior.
 15. The method of claim 10, whereinaccessing a generic scene graph comprises accessing a generic scenegraph that programmatically defines the platform independent inputgesture processing behavior.
 16. The method of claim 10, whereinrecognizing an input gesture corresponding to the input gesture datacomprises utilizing a gesture recognition technique available to thedevice platform.
 17. The method of claim 10, wherein receiving inputgesture data comprises receiving at least one of: voice input gesturedata or video input gesture data.
 18. The method of claim 10, whereinreceiving input gesture data comprises receiving at least one of: mouseinput gesture data or keyboard input gesture data.
 19. A computer systemcomprising: a processor; system memory coupled to the processor andstoring instructions configured to cause the processor to: access ageneric scene graph defining a platform independent data visualizationbehavior; derive scene graph metadata that describes characteristics ofthe platform independent data visualization behavior; interpret thestructure and data of a scene graph node in the generic scene graph intoa platform specific data visualization rendering operation compatiblewith a device platform; generate a data visualization from processingthe platform specific data visualization rendering operation; and outputthe data visualization at a rendering sub-system of the device platform.20. The system of claim 19, wherein instructions configured to derivescene graph metadata comprise instructions configured to infer the scenegraph metadata from features of the generic scene graph; furthercomprising instructions configured to receive input gesture data fromthe device platform; and wherein instructions configured to generate adata visualization comprise instructions configured to generate a datavisualization responsive to the input gesture data.